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ABSTRACT* * - ' . ^ 

* ' Fpcused*on the ^impact of the institute program for 

inservice teachers sponsored tjy the National Science Foundation^ this 
^report summarizes t^e findings of 138 documents, {research and 
evaluation' studies) . Documents 'reviewed were grouj^ed into 
dissertations and theses (6.3) ^ journal articles^ {^^) f interim or 
final reports (23) , papers presented at professio'naj. aeeting's, (9) ^ 
and books (2) . Information contained in these documents was 
snmmari:^ed in terms of six subcategories: Characteristics of 
Participants^ Subject Matter Competence^ Teacl\er Attitudv»s^ Teaching - 
Behavior, Understanding of*Science^' and Career Effects. Examples of 
studies fitting into each of theiSe' categories^ were selected for 
illustrative purposes* In addition to the discussion provided for 
each of the 'subcategories , a four-page summarization is also 
included. (PEB) * " * 
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IMPACT Ol'- THl!: NATIONAL SCI KNCK FOUNDATION 

' TEACHER INSTITUTIJ rUOGRAM 
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INTRODUCTION ' 

Over the past two decades the National Science Foundation has sponsored 
hundreds of institutes attended by thousands of classroom teachers and ad- 
ministrators. That these institutes have had a beneficial impact upon 
education seems widely accepted by participants, principals and administrators 
college personnel and educational observers (65), There has been less agree- 
ment, however, about the precise nature o,f this impact, stemming in part 
from the different kinds of research and evaluation studies of the various 
institutes . 

The citations included should be considered repiescntative of studies 
conducted rather than an exhaustive bibliography. Table 1. presents a 
categorical brc'akdown of the 138 documents reviewed. As is the case in most 
educational Research, the majority of the studies, .64, were in 'the form of 
theses or dissertatioiis . Many of these, however, were follow-up studies 
of long term evaluations extending" beyond a single year in scope. Approxi- 
mately one third of the studies were reported as journal articles, account- 
ing for 41 of the documents. Twenty-three docutnents were categorized as 

ft 

reports, most of which were interim or final reports tp NSF. Finally, 
there were n^e pi:escnted papers and two books' jtncluded. In a few cases 
two citations are included which resulted from the same study. In^these in- 
stance's the intents and emphases were different, lience the duplicatio.n. 



TABLE 1 

Types of Documents Reviewed ^ j^- 

Disiiertations and Theses 63 ^ 

Journal Articles - 41 * 

. • I. ' ^ 

Reports * " * 23 

Presentefd Papers ^9 

^Baoks * ^ • 2 

TOTAL ^ " * 138 . 

* 

Much of the research was of a descriptivQ nature dl^aling with character- 
istics of the in^trtute participants, their attitudes, various aspects of the 
programs or changes in teaching behavior perceived by students, principals 
or the teachers themselves. Several, studies were concerned with changes in » 
the teachers' subject matter competence. Relatively few studies dealt with 
the impact upon students of the** institute participants. Those th.at did tended 
to emf^hasize student achievement, attitudes, and undcrstaiiding of science. 

Rather than reviewing in detail each of the studies, examples will be •* 
selected for' each of the general categories, "Results and bindings V7ill be 
summarized and synthesized in an attempt to derive some general conclusions 
about the effectiveness of the NSF institute program. Because most of the 
studies were multifaceted , ^nany will be cited in more than one category. 
For the present purpose, major emphases will be placed on^ the impact on ele- 
mentary and secondary school science teachers as a result of their partici- 

> 

pation in the Institute Program and on tl)e impact on students of such teachers 
Although occasional reference will be made to curriculum change, devcJopmcnt 
or implementation, much of this information has been summarised elsewhere 
[Howe (54), Schlessinger, et, al, (108), Maben (71), Nelson (85), Webb (128)] 
and will not be presented in detail here. ' 



,,■ : ■ / \ ■ 

. IMPACT OK Tl-licilEKS 

' Prime concerns oiVtho NSF insLit;\iLe.s , l^articulariy in tlie early years, 
.'■■'/ 
were to upgrade the- backgrounds of the Lqacliers and to bring about a cliange 

• ■ > / / 

. in the way science was taught in the f>choQls, It is not surpri.sJnji, IhcMi, 
that the .majority of the studies were conjterne^ with the teachers as par- 
ticipants in various institutes, their c|iaracteristics , and the upgrading 
of their content backgrounds • Studies dealing with the various teacher-''^ 
participant factors will be summarized in the six subcategories. Character- 
istics of (Participants , Subject Matter Competence, Teacher Attitudes, Teaching 
Behavior, Understanding of Science, Career Effects, 

Characterise tics^of Participants 

" — ,^ — _ 

Virtually every study contains some ^information with respect to the 
participants. Rather than dompiling a listing &f the various factqrs included 
it appears more useful to examine certain of the studies to determine in 
general, 1) characteristics of institute participants, 2) differences between 
acceptees and rejectees among applicants to institutes and, 3) differences 
between. applicants and non^-applicants.. 

Dzara (31) investigated certain aspects of NSF summer institutes held 



\ 
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a^t the University of Alabama from 1957-1962 • One hundred nineteep of the 
130 participants responded to the questionnaire. He found that the age range 
of the. participants was from 23 to 59 with more than 80 percent under -50 years 
of age. Participants had from one to 37 years of teaching experience with 

\ 

eighteen teaching majors represented based upon undergraduate preparation. 
Using earned credits' as the criterion, Dzara found that the .majority we^re in- 
adequately prtspared*^ to teach Science although 49.4 percent held the Master's 

V 

degree. 



I 3 

ERIC ^ 



In a series'of studies, Flesher, et. al., (33^ 34, 35\ 36, 37) examined 

the nature of* the participants and program for four Academic Year Institutes 

at ThejOhio State University from 1957^ through 1961. Of . the 204 participants, 

41 were women; the 4 to 1 ratio remained essentially constant over the four 

years. The ages of the participants ranged from 23 ta 54 ye^avs with the median 

approximately 32 years.. Although the percentages varie^d f;:om year to year, 

* <. 

« •> 
approximately 80 percent of the total numbef of pai^ticipanta were married. 

Inching eocperience possessed by the appj.ic^nts ranged 'from 2 to 30 yo.ars 

with the median at approximate^ly. 6 years. Eighty-eight . participants , approxi- 

mately 43 percent^ held both Bachelor's and Master's degrees, while 116 held 

only the Bachelor's degree. Most of, the undergraduate majors were in the area 

^ of science. Areas of preparation with approximate median credit hours ^wcre 

biol<Jgy, 24; chemistry, 16;- physics, 11; earth science, 5; mathematics, 15;^ 

and education, 34. The number of teaching fields vari*ed from one tp five 

■" • ■ ' ^ \ ^ 

with approximately 70 pqrcent teaching in one or two fields. * 

In a study of characteristics ^ and opinions of participants at NSF Academic 
Year Institutes hej-d at the University of North Carolina at Chapel Hill during 
1968-1971, Macon (72) found, results^ very similar to those in other studies. 

In the category of personal data he reports a male-female' ratio of '!.5 to 1; 

* ' -J * ' ' ^ 

a ma r^:icd-s ingle ratio of 2.7 to *1; and"{in average age of 3L.6 ye« In the 

1-,' \ 

area of prpfcssional characteristics he notes that 2*8 percent hci Master's 
degrees, 76.5^ percent were biology majors (the institutes were in Uie biological 
sciences), th6 average undergraduate biology credit \ as *32 •6'hours , and that 
9.7 percent were deficient in certification. He also found that 22.2 percent 
bfeld membership in NSTA. This last indicates a linding common among other 
studies that participants were more likely to be members o£ prpfessional ^ 
associations than were non-participan ts • 



,•111 a Sipudy, of .•;Clect:i0n ^proccdurd's and" pradicli'on, of lsuc;cc»ss for NSK 

Academic Year 'Institutes , Dc^faey (29) coJUccted data from parlicipantf? at 

' . ' . * 'V ^ ' 

2li institutions which had AYI programs in 1966-67. He fqund that various ' 

J NSf-AYJ programs did use diffe^rent criteria Cor selaoti,ng candidates. In 

examining possible^ p,redxctors fiorVsuccess in the institutes he found the 

' > * *♦ • ' * 

« best cognitive predictors were undergraduate grade poijit average, Graduate 



Record. Examination Score, and number of hours of chemistry. The Edwards 
Personal' Pref(^rence Schedui^e' dimenjs^nfe of oVder and, Heterosexuality were 
the best noncognitive predictors. "It* is interesting to note that the Hetero- 
sexuality diltieosion" was found in a study tOf the characteristics of physics 
teachers by Rothman, Walberg and Welch (102) to';be the single teacher variable 
c^relattftH to 'the most measures of student learning; students were most likely 
to c.%^iibit; growth in understanding pC ,S\2leiice, achi^v.emjent in physics, and 
knowiodge of the processes of science.' U^ile the two studies dualt with 
different populations., the findings suggest the possibility that those^ factors 
which, ^predict success for the teacha^^s An institute participant may be 
factors v/hich promote cogn.itive sucie^s' by ^udents* 

Jorgonson (61) studied the characteristics of teachers applying to 
Acadcmi^c Year tins titutc programs at Or,egon State University, frojn 1957 through 
1962. The sai^ple included all acceptees and" a randomly selected half of the 
rejectees. Considerable variation in characteristics existed when comparing 
applicants from one year to another. Acceptees and rejectees were different 
on the' basis of undergraduate science grade point average, undergraduate 

i 

science credits, science major, teaching residence, teaching experience, and 
membership in state and national science organizations and membership in the 
National Science Teachers Association. In terms of the Anijerican Association 
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fjOT the AdvancGment of Science guidelioes, many applicants were lacking in 

depth and breadtb of s^iende and mathematics preparation. 

Be^ger and Berger (10) report a study of attributes of applicants to NSF 

summer institutes in 1-96*4 in which they compared acceptees and rejectees. 

.... 

Personal characteristics such as age, citizenship, marital status, nOmber of 
dependents and allowance requests, and city, state, or region of residence 
did not appear, in general, to have iYiflucnced selection.. Educational back- 
ground, however, did appear to be a factor. A fhirly consistent finding was 
that l^he^'great^r thp. total number of undergraduate or graduate credits JLn the 

* A • ' - . ■ ■ 

various sciences, the greater the probability of being selected. In some 
cfases "undergraduate credits in chemistry and graduate Credits in biology, 
phy^iics, and earth science, appeared tb favor selection. Undergraduate grades 

V 

appeared to be a' strong factor. Acceptees usually had higher grades than did , 

rejcrctces and^ for most groups, the^e differences were statis,tically reliable. 

Gradu&te grades did not appear as strong a faotor as did undergraduate grades 

but. did indicate the s^aine trend. Applicants to secondary or college institutes 
j. ^ . '/ " ^ ^ . ' 

whose undergraduate preparati-on emphasized science or mathematics appeared to 

have a significantly bet.tex chance of being 'selected if their preparation, 

was largely in educational methods* The major for advanced degrees appealed 

not to be' a factqr in selection. <^ Professional experience ^including leaching 

a specific suTJJ^cL seemed to be favored at several .institutes, howe.tr, the*^ 

subject (biology, chemistry, physics, mathematics, earth soietice, or general 

science) varied. Teaching predpminantlj^ science or ma^hematic3 during the ^ 

^ ' ^ . ^ ' . ^ \ 

five years proceeding application generally Increased acceptance. Finally, 

ulhet professional interests such as journal rp'a^ing and mqmbership in pro-^; 

fessional organizations seemed* to have some relationship^ to acceptance or • 

rejection. * ^ ' * \ 



Differences between applicants and non-applicant« to NSF Institutes 
were studied by Orr and Young (90). On a nationwide basis, 55' percent of all. ^ 
science and mathematics teachers had not apjilied to an NSF institute, 13 per- 
cent had applied and been rejected, and 32 percent* had attended at le^st one 
insti^tute. Of the personal factors such as age, sex, and marit^il status, " 
onfy sex i^ppeared to be related to applicati'on to institutes with a larg^er 
percentage of men than women applying. In ^general, applicants had a greater 
total of graduate hours than n6n-appli cants and there was a larger percentage 
of applicants than non-applicants with scic\ice and mathematics majors at 
both the undergraduate and graduate levels • A greater percentage of non- 
applicantJ^i than applicants had majors outside of scicace and mathematics educa- 
tion and non-applicants taught a greater percentage of non-science subjects 
than did applicants. 

Orwick (91) in a study of high school teachers participating in NSF 
instituti^^ in Nprth Carolina investigated, among other things, differences 
between eli^^ible applicants and eligible non-applicants in, a- six Couity^ea 
in North Carolina. Of the 119 respondQ.nts to h4s quesj^onn^are 86.6 p'ercent 
were eligible for NSF institutes. 0£^^tl^o5e--cilgi^ 64.1 percent had par- 
ticipated in at least one NSF institute, 16.5 percent hatl applied and been 

* * • 

rejected, and 19.4 percent had not applied. He found that science teachers 

who Imd applied for NSF institutes and science teachers wlic had, not applied 
diffcrcu appreciably: applicants civeraged more semester hours in undergraduate 
and graduate science course work than non-^apglicants,; npn-applicants averaged 
more semester hours in undergraduate and graduate education course^; a larger 
percentage of applicants held Master's degrees J a larger percentage oT appli- 
cants had filture plans for a, graduate degree, a larger, {percentage of 
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non-applicants taught 60 percent or more non-science subjects; applicants^ 
read more professional journals; and, a larger percentage of applicanf^s than 
non-applicants had attended Ispmmer school each of the past fivc\ycai^. Dif- 
ferences found between acceptees and rejectees^ among the applicants, were 
generally similar to those already .-indicated for other st;-udies. ^ ' • 

Other btudies related to characteristics of participants include Bartlett 
and Edgerton (6), Gibney (43), Heideiiitin (49), Jax and Merrill (60), Kastrinos 
(62), Koelsche (64), Nixon (8.8),^ Sea (110), Slawson (114), Yegge (]' O; and, 
' " Yegge,* et- al. (136). 1 " ' . 

The studies reviewed, and cited were conducted in various parts of the 

count p.)'' with differing participant populations and utilising different pro- 

^, aedurcs for data collection and analyses. In spite of tha^e variations, the 

• « > 

results appear fairly consistent for many of , the characteristics examined. 



VJhile this is encouraging in terms of generalizing the findings^ it points to 
♦ at least one disheartening conclusion. The participants tended to be those 
teachoifis who had better grade poijil averages, more, science preparation 

» » ' ' « » * 

(although this ma/ in Itself have been deficient in some cases) , mo^e teaching 
responsibility for teaching science, more interest in further education, and 

• more interest and activity in professional -organiz/itions • In 'short, *those 
persons most likely to be iristitutc participants werl those who were- already, 
on these scales at least, the better qualified, ^ Hence it appears ^lat the gap 

between the better and the lesser preptired tended to be widened. It should be 

> - . ' ' * f 

* * 

X noted, however, that tHe non-^pp] icants and rejectees .were more likely to 

• leave teaching than were th(s participqats thus mitigating the disparity qf 
impact* • , • " 



•8- 
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Sub-i e c t Ma t to r ,_Co mp c t; ( \n ce ' ' ' 

When the Nat^ionnl ScicMicc Fountlnl l.on was t'stnbl l.shed in ]050 Ii vras ' ' 

charged with developing a national policy for the Vromot^on of basic research - 

», • 

and education in the sciences. In accord with. this charge, conferences were 

">■-'- ^ ^ ^ ' , 

held to explore^". . i tlVe sin^;ular importance of the high school teacher's ^ 
subjt?cl~matter problem and the feasibility oC'^nSf's establishing programs 
designed to alleviate this .problem . . Since that time wer 470,000 oppor- 
tunities for training have been offered. The results have been likened to 
the classical "before" and "after" advertisements. With respect to "biology . 
teacheifs, early institute participants were of the general sciience type 
whei.eas today's teacher of high school biology "is typically a singlQ discipline 
instructor (Adams,- 1). That* such improvement is not limited' to biology teachers 



can bo seen from many studies. 

Gibney evaluated the 1976 summer institutes for secondary school 

teach'irs of science ^and m.ithematics . Bathed upqn 4^476 returned questionnaires, ^ 

' ' * » *^ 

liQ "found that the pcir ticiipants perceived that inservice education would best 

■. ' • ' ■■ . > 

serve to bring about rlassroom improvement, Wliat this inservice education 

should entail, however, varied with the kind of institute the participants ♦ 

had attended. Of those attending uon- implementation institutes, most stressed 

updating the teacher b subject matter backgrounds and in-de?pth teacher education. 
'* * , - ^ 

One indication; of success may be inferred .from the fact that two-thirds of^ 

the participantb reported implementing new curriculum materials in their class-* 

roorn^ following institute participation. ' ^ 

. B^rekke (16) reported bhe results of evaluations received from participants 

who attended N,SF institutes at the University of North Dajkota from^ 1957 through 

1962. Data were collected fiDm approximately half of the 277 former institute 
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participants,^ froth principals of 70 h ih scho6?-s to which Institute teachers 
returned, and frbm 29 principals of. high schools which had no institute- * 
trained teachers. 'Nine out of .ten participants rated their growth as more 
than moderate Cone a^ f ive-'point scale) in tha area of strengthened science 
and mathemdtics background. High school principals of institute, participants 
rated the extent of the teacher's improvement as moderate or greater than 

# 

n^deratu in 8^ percent ol tho^cases, Moi"e than 60 percent of the principals 
rated the teacher's gains as .more than moderate following roturn from in- 
stitutes for 1) efforts to obtain and improve science and laboratory facilities 
and.equijjment , 2) all around teaching ability and effectiveness , and 3) added 

r 

subject matter cbmpetency. It was found that ijiore students taught by in- 
stitut'c participants went on to elect college, courses in science ar^d mathe- 

- matiqs ^reas after the teacher's institute experiences than bef ore ^ The 

f 

teacher's increased subject matter competency was rated as being the major 
factor in hie increased ability Ho motivate studem:s toward such careers/ . 

Welch and Walbcrg (133) evaluated four summer institutes for ph/sics ^ 
teaclicrs. One hundred sixty-two teachers were' tested with a pre-post-test 
battery of instruments which included the Test on Selected Topics in Physics 
(TSTP), the Test on Understanding Science (TOUS) , and the Welch Science Process 
Inventory (SPI) . Significant gains occurred on TSTP for each of the institutes 
indicating an increase in subject matter competency. Significant gains on ' 

TOUS were found for teachers at three cjf the four institutes suggesting suc- 

- . i \ 

' qess in increasing understanding of science and scientists. Finally, 

\ positive gains*were found for all institutes on SPI, however, only the mean 

gains at two of the institutes were significant. It .waa concluded that, to 

the extent to. which the instruments reflect the objectives of each of the 

^^^^^Jjl^ux sumnier Institutes, a change in subjt»ct matter compe*. ,ncy wds effc^cted, 

10 
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In evaluating an inservice program for earth science teachers, Mayer, 

\ 

Disiuger and Wliite (76) assessed, among other things, the effects of the 
program bn participant knowledge of earth science .fucts and concepts. A 
pre-post-test 'bf an instrument designed to reflect achievement in the behav- 
ioraJy objectives stated in the Teachers Manual for I nvestigating the Earth 

v_ was administered tq ^0 participants. The gains were significant, sugges^^ng 
that the program was successful in accomplishing'this objective. 

Similar results .were reported-by Ost (93) who found that participants 
significantly increased in their ability to perform operations of science 
after attending the institute; Ostlund (49) also. reported significant in- 
oreases in achievement test scgres for participants following attendance at 
an Academic Year Institute. With elementary school teachers as suljjects. 
Fowler (39)" reported significant gains on the Read General Science Test. 
Selser (111) found that science teachers who had attended an institute, when 
compared with control teachers who had not attended the institute, made signifi- 
canely highe^c scores on the Sequential Test of Educational Progress and on 
the Test on U^i^erstanding Science indicating gains ,in understanding of con- 
cepts of scieace and of the nature of science. 

• , LaShier (66) assessed the effectiveness of a Science r A Process Approach 

Cooperative College-Schdol Science Project involving 30 teachers and 5 ad- 
ministrators. He found that the participants exhibxCed significant pre- to 
post-measure gains in competency based on the Science Process Measure for 
Teachers. ^ ^ 

Other studies dealing with subject matter competence include Berger (9), 
Bingham (11)\ Bradberry (14), Brandon (]3') , Brittain and Sparks :'(19> , Bruce 
and Parakh (22), Dzara (31), Exline (32^), George and Rose (42) , Gray (44), 
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Highwood and Mertens (52), Irby (56), Jenkins (59), McGormiok (77), McCurdy 
(78), Menesini (79), Nlcodeiuus (86), Oyl (92); OsUluiid (95), Passp.ro (97), 
Redburn (100), Selser (111), Slawson (114), Spradlin (116), Sutherland (118), 
IVoeten (123), and Ward (127.). 

With respect to changes in teachers' subject matter competence related 
to the NSF Institute Program, there is greater agreement than in any other 
area. Nearly every study and document reviewed indicated that in this area 
the Institute Program was clearly a success. 

Teacher Attitudes 

Studies related to teacher attitudes ranged over a broad spectrum in- ' 
eluding considerations of attitudes toward certain curriculum materials, toward 
science, and toward teaching. 

Ost (93), in evaluating an institute for teacher^ of secondary school 
bloloty, test^ed the hypothesis that there would be no difference in the atti- 
tude^ of the participants towards BSCS materials and rationale b'eforc, and 
after attending the institute. The BioJogy Teacher's Attitude Inventory vai^ 
mailed^ to the participants beforehand six months after the institute. A t- 
ratio fot correlated means was calculated for the scores on the Inventory and 
found to be significant. It was concluded that .the attitudes of the p.<' Ici- 
4)ants towards BSCS materials and rationale did improve after attendin^rj > 
, institute. 

The evaluation of a leadership workshop on elementary school scien c 
reported; by Merkle (80) focused, in part, on changes in knowledge of and 
attitude toward AAAS and SCIS elementary school science curricula, and on 
the effects of various aspects of the workshop activities on the attitudes of 
the participants. He found that participants'pre-post-test gains in laiowledge 

\ - ' . 12 



of program characterisLics and prpgram implemcnLaLion procedures were sir.nifi- 
cant and that the participants also exhibited a significant positive change 
in attitude toward the programs from prc-te^t to ^post-test . However, partici- 
pants scores on atcitudes towa^,d the , workshop were not found' to be significantly 
related tu thw participants knowledge of program characteristics, program im- 
plcmentation procedures, or at>irttjdes towards the programs. 

Chapman (25) investigated the effecjts of a six week summer institute 
on elementary school teachers' attitude/ toward science and their understandings 
about tbe scientific enterprise, scientists, and the methods and aims of sci- 
ence. The .experimental group consisted of teachers participating in the in- 
stitute and the contrpl group of randomly selected elementary school teachers 
in other summer session classes. Both grou|)s given the Test on Understai\^ing 
Science and the Button Attitude Toward Science Scale at the ^beginning and 
closq of the.sumwtir session. The experimental group showed a significant 
gain on pre-post test scores on TOUS ai^ significantly grea^ter change in post- 
test scores compared to the control group. However, the experimental group 
^ did 'not show a significant change on the Dutton Attitude Tpward Science Scale 
nor was a significant relationship found between attitude toward science and 
understanding of science as measured by these instruments.' * ^ 

Rather similar results were found by Simmons (113) in a study of elementary 
teachers involved in SCIS workshops. A semantic differential instrument was 
utilized in a pretest-posttest mode to evaluate, in part, teacher attitudes 
toward piemen tary science. Tlie data failed in nearly all instances to reveal 
any major attitude differences between the experimental and control sample. 

Irby (56) > in a followup study of AYI participants at the University of 



, Missipslppl frfcm I?96i-1966, gathered data on 151 secondary school mathematics 
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and science teachers. Among other conclusions, he noted that the professional 
attitude of teachers who had attended ap institute was improved, 

Brekke (16) reported on a similar follow up study for par\:icipants who 
attended NSF institutes at the Uiiiverisity of North Dakota. With respect to 
attitudinal changes he concluded that major desirable changes fostered by 
institute attendance were an increased enthusiasm for teaching science *and 
mathematics and a desire to gain a^ graduate degrere thro^igh further study,. 

Rothman, Walberg and Welch (102) studied changes in teachers' attitudes 
toward physics and towards several activities related to the teaching of physics 
Fifty-six teachers were randomly selected from a national population of approxi- 
mately 17,000, Thirty-six of these teachers participated in a summer Institute 
while the remaining 20 served as the control group. No overall significant 
difference was found on the "student activities" scores, leading to the con- 
clusion that teachers' attitudes related to these activities were jpot affected 
by the summer institute. It was found, however, that the teachers in the 
experimental group rated science as more understandable and physics in their 
lines as less complex and also rated science as more important but physics 
less important, Fron1t^:JHese findings it appeared that the factual content 
had been effectively presented, 

Zurhellen (13,8) evaluated attitude changes among science teachers during 
an ESCP inservice institute. The population consisted of 75 teachers and 20 
leaders who attended the introductory sessions and were, involved in the year 
long program. No significant changes in attitudes on the part of the leaders 
was found. However, there were significant altitude changes exhibited by the ^ 
teachers in the areas measured by the Minnesota Teacher Attitude Inventory 
and the Teaching Situation Reaction Test and in areas of My Ideal Teacher, 

■a ' 



My Ideal Student, and My Ideal Self measured by a Semantic Differential 
Scale. The pattern of shift in attitude scores was positive across thq 
August session, negative from August to January and mixed from Januaxy to 
April. This indicated thjs ]^ossible harmful effects of long-term inservice 
programs and suggested, the efficacy of several short-term concentrated work 
sessions-. * J 

Other studies related to teacher attitudes include Dean (28), Gruber (45), 
Hassard and Smith (48) , Heideman (49) , Horner (53) , Kulleman (55) , Jenkins (59) , 
Nicodemus (86), Parker (96), Sa.mer and Edmun^ (106), Spradlin (116), Sutman 
(119), and Yegge, Watson and White (136) . . 

The results of studies reviewed in this, area do not readily suggest 
clear cut conclusions with respect to specific conditions. For example, in- 
creased knowledge about a program did not always appear to be related to a 
change in attitude towards that program. Tfie results do suggest,, however, 
the .general conclusions that positive attitude changes could be, and were, 
brought about and that the institutes appeared to be significant fattors in 
those changes. The permanence of these changes remains a partially answered 
question although follow up studies after time lapses of one to five years 
often found attitudes of participants to be markedly positive, /"particularly 
toward the institutes as experiences beneficial to the participants. 



Teaching Behavior ^ 

In order to 'bring about change in science, education it was determined 
that not only was updating of the teachers* background necessary, but the 
way in whicli science was taught needed to be altered (Kreighbaum and Rawson, 
» 65). The degree to which this objective y^as accomplished was a facet of 
^many of the reported evaluations. ^ ^ 

Anderson and Horn (A) assessed a^model for the .diffusion of the new 
elementary school science curricula. Tiie model, funded thrbugh the Cooperative 
College^SchuoI Science Program, employed a limited number of personnel to 
promote diffusion on a large scale basis. One of the first major concerns 
was to determine whether the teachers' style of teaching changed as a' result 
of partigipatioa in the project. 'iVenty-eight teachers wefe randomly selected 
from approximately 150 teachers as a group from ^which pre-test data could be 
acquired and a different set of 28 were selected as the source of posttest 
data. Changes in teaching style were assessed through observation and the. 
use of the Xeachinf^ Strategists Observation Differential (TSOD) , This instru- 
ment provides an overall rating of the style of teaching employed by^'a 
teacher on a continuum with expository-direct and indtict^e-inditect repre- 
senting the extremes. All. teachers were provided with the same materJ Is ^ 
for use during the class scheduled for observation and a 20-30 minute . g- 
ment of teaching was videotaped prior to the. inservice classes. After com- 
pletion of }:he inservice classes, a similar sample of teslching was recorded < 
fo^ the other selected group of teachers. The samples were rated by a 
group of four ratefs following a randomly determined pattern of rating. The 
average Hoyt interrater reliability was .94. The gain from pretest to post- , 
test was significant at the .01 level, The investigators concluded that the 
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one semester inservlce course had produced a change in the teacher^/' style 

if 

of teaching* 

In a study of an NSF summer institute conducted at Ball State University 
Hendren, Mertens and Nisbet (50) investigated the usefulness and degree of 
implementation of 55 specific topics included in the institute. Prior to^. 
the institute each participant was asked to assess the emphasis he had 
placed on each topic during the preceeding school year and to indicate, on 
a 1-7 scale, what emphasis he desired, ta place oa each o-f the 55 topics in 
the future. On the last day of the institute each participant was again 
psked to^assess the level of attainment he wished to achieve fqr each topic 
during the school year* At the end of the following school year each teachei 

assessed what he actually accomplished .during thfe school year. The , data 

^ * - - 

suggested that the institute was effective in motivating the participating 

teachers to increase in. their own teaching the level of emphasis given to y 

■ ' ' ' . / 
45 of 55 instructional topics stressed in the instit^ute,, 

Berger (9) compared groups of teachers of elementary school science on 
their predicted behaviors *in order to study the influence of NSF teacher 
training institutes for and experience with the Science Curriculum Improve- 
ment Study (SCIS)' teaching strategies. The groups selected included 51 
teachers not exposed to SCIS, 69 teachers not exposed to SCIS but starting 
an SCIS institute, 76 teacher^ who had completed an NSF institute in the , , 
SCIS program, and 45 teachers who had completed a four week institute and 
had taught the SClS , curriculum for at least one year. The groups of teachers 
were compared using the Predicted Role Measure which involved a film of 
elementary school classroom scenes and a response sheet. When the teacher 
in the film was to make a decision,^ the film was stopped and the participaijts 
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were asked to respond by rating their^ agreement to behaviors they might 

t 

exhibit if they were the'teache^ in the film. The responses were scored 

and ^hS scores separated into tlyree categories which were essentially 1) a 

teacher-oriented scd^e, 2) a student-teachet cooperation score, and, 3) a 

student-oriented score The Predicted Role Measure reflected a vnrlcty 

of situations, was specific enough to proXride common input, reflected actual 

teaching decisions rather, than broajd attitudes, and it reflected and dis- 

criminated between the differing teaching behaviors described by the SCIS 

curricula. Split-halves reliability wap^ established at CL^4 and a com- 

^ parison of predicted behaviors tu actual observed classroom behavior estab- 

■lished a validity of 0.74. In general, there was a positive correlation 

between experience of teachers with Vhe SCis program ^nd their degree of 

agreement with the SCIS criteria judging group. There was^no significant 

<Iiffcrence between the scores of the^51^j^-SCIS instruct^ion group and the 

69 prc-instruction group as measured by^ multivariate analysis of variance. 

There was a significant difference between the scores of the pre-institute 

teachers and the post-institute teachers. Post-institute teachers were 

less teacher-oriented in their scores than were pre-institute* teachers. 

Post-institut/2' teachers and post-institute teachers with one year experience 

teaching SCIS did: not differ significantly in their scores. It was also 

determined that there was no overall significant relationship between the 

background variables of .a^e, sex, years of teaching experience, grade level 

taught, enjoyment of teaching science, number of years of college scienc5e, 

and number of i^cience methods courses and the scores an the Predicted *Role 

I 

. Measure. It was conc],uded that teachers who experienced the NSF institutes 

• » * . w , " " 

and/or taught the SCIS curriculum changed their predicted teaching behaviors 
in the direction of the SCIS staff judging group*? 
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, Bridges > Binuhmu and Green (18) evaluated the Cooperative College- 
School Sci&nce Improvement Program to ,prepare teachers to teach the DISCUS 
program. To determine whether there were differences^ between teachers 
who were .trained' and those who were not, videotapes were made in classrooms 
of both tjained and untrained teachers. The tapes were analyzed using the 
Teacher Practices Observation Record (TPOR) and the Reciprocal Cate*gory 
System (RCS) I It was postulated that if the cl'ass atmosphere was success*- / 
oriented, analysis, of a videotape should ohcw it to be more in harmony with 
the basic philosophical set of the DISCUS materials which would^ he in accord 
with Dewey's "Experimentalism" and less "Autho*:itarianism" in natureV The 
investigators found that teachers trained for the program did operate in the 
classroom more in harmony with the "qxperimentalisml' philosophy than <}id 
the non^trained teachers. The trainf^d teachexs also provided more active 
student involvement, less external disciplinary control, and more student- 
centered instruction, Differences in teaching methods were apparent with 
groups taught by trained teachers showing more student-directed, teacher- 
guided activity and mor.e often using the il^.quiry method of instruction, it 
was concluded that the results clearly supported the training program. 

Spradlin (116) reported a study to determine whether increased subject 
matter knowledge and exposure to new teaching strategies in a special 
Institute Program would effect any change in the classroom behavior of an 
inservice' teacher. The sample included 50 science teachers who had partici- 

pated in a Sununer Institute Program at the University of Texas at Austin in 

♦ 

1971 and jLheir 1240 secondary school students. The study used a one group 
pretest, posttest research design. Prior to the end pf t]he 1970-71. scho^, 
year, one class for each participant was given the Science^ Classroom Actj.vity 
Checklist and a Student Semantic Differential. Pre-ins titdte measures taken 
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for the teachers included a Teacher Semantic Differential (TSD) , a Teacher 
Concom Statement (TCS) , NSTA's Annual Self -Inventory for Sclerice Teachers, 
and content tests for earth science, biologipal science, and physical science. 
All measures were repeated following the next year. The results .indicated, 
among othei: findings,' that participation in the Summer Institute Program 
worked to improve thd( teachers' classroom behavior patterns, pGrcept4^n of 
self as a professional person, their level of teaching concerns to more ^ 
Student centered ones, and increased their content knowledge. 

Additional studies dealing withXchanges in teachitig behavior include 
Adsims (1), Amend (3), Brekke (16) B^ovme' (21) , Bruce and Parakh (22), Frantz 
(40), Flores (38), Gardner (41), George and Rose (42), Gruber (45, 46), 
Gruber,r Brady and Means (47), Highwood and Mertens (52), Hassard and 'Smith (48), 
Heideman (49), vTacksoa (58), Jenkins (59), Klimas, (63), LaShier (66), Marshall 
(73), Mayer, Disinger and mx±te (76), Merkle (80) /ost (92, 93), Nicodemus (86, 
87), Parker (96), Redburn (100), Petrongolo (99X, Sarner and Edmund (106), v 
Simmons (113), Schmidt (109), Sutman (119), and Thompson* (122) . 

7he preponderance of evidence presented in these studies indicates that 
teaching behavior in most instances did change following the teachers ex- 
periences in the various institute programs. Moreover, these changes tended 
in general to be in the directions desired by the institute organizers. The 
changes were perceived .positively by the teachers themselves, by their students, 
and by their supervisors.' While factors other than institute participation 
cannot be excluded in all cases, it seems eminently reasonable to conclude 
that the institutes were significant causative agents in promoting^ improved 
teaching. It does not necessarily follow, however, that such iijiprovement 
remains a permanent condiCion. ^ 
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.Understanding of Science ^ * 

The relati'ohship of the* Institute Program to the participants increased^ 
knowledge ancj subject matter competence -has already been summarized with 
respect to a discipline-oriented perspective. The broader concern of teachers^ 
increased o-r changed underjstanding of the nature of tlie scientific enterprise 
with respect to the methods and processes of science was also reflected in 

• a number of studies. 

Wittwer (134) reported the evaluation of a Rese^lrch Participation Pt<5- 
gram (RPP) at the University of Wisconsin. Among the objectives eva-luaicd 
were the -extent to which the progra,b h^d provided activities, and resuonsibil-. 
ities meaningful in terms of research in, science or ' mathemdtics ; had enabled , 
the. participants to generate tangible research results; and, had developed 
in' the participants understandinjg of the methods or processes of science. 
Based upon opinions of the supervising professors, more than 90 percent of 
the RPP teachers gained a fueling or understanding of the regl nature 6f 
research. .Also^ J,n the opini'dns of the supervising professors, nearly half 
of the RPP teachets made a significant contribution to the research discipline 
and nearly three-fourths ma;de a significant contribution to the output of ^ 
the professors' laboratories^ One-third of the research findings were pub- 

, lished and one-fifth were presented before professional rejsearch^ societies . ^ 
The RPP teachers also scored significantly higher on the Science Process 
Inventory than did a comparable group of teachers without the research experience. 

The effectiveness of an inservice institute in increasing knowledge of 
Content and the ability to Understand and use' broad concepts in mathematics 
* and science was ^ssesseci by Selser (111): As a part of this assessment, the 
Test on Understanding Science (TOUS) and the . Sequential Test. of Educational' 
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Progress were administered to 20 science teachers who pai;ticipatecl^ in the 
institute and to an equal number of control teachers who bad not attended the 
institute. , The science tea(?liers who 'attended t]ie institute made significantly 
higher scorer on both STIvP and TOUS instruments than did the control teachers. 
This indicated a greater ability to understand concepts; of science and A 
greater understanding of the nature of science'^n the part of the participants. 

Chapman (25) Investigated the effect of an in.^ervlce elementary school^ 
science summer institute on elementary teachers' atV^tudes toward science and 
understandings about I'the scientific enterprise , scientists , and'the methods 



and aimsN^f science.! The experimental group consisted of those teachers vho 



participated in the -institute while the control group was composed of randomly 
selected elementary teachers in other summer session classes. The TQUS in^ ^ 
strumcnt, along with ot^her data collected, vjas administered to both groups 
before and after the summer session. Among -other findings, it was determined 
that the experiment§il group showed a signif i^aTitly greater^change in total 
score on the TOUS post test over the pretest than did the control group; that 
the expei;imental group' showed a significantly greater change in total score 
on the TOUS posttest compared to the total posttest score for, the contirol , 
groupj and that no significant relationships were found between TOUS scares 
and the variables of hour^ of college science^ life science, physical^ science 
and mathematics, years of high school science ^d mathematics, average college 
grade^, average high school, grade, age,; or experience. It was concluded that 
such, a summer *institute could result in significant changes in .science under- 
standiij^gs by participants. * • ^ , 

Welch and Walbeifg (133) tested 162 physics- teachers Wio were participants 
in fdur different summer institutes with a pre-posttes(: battery of instruments^ 



which included the TOUS'and SPI, Significant gains on TOUS were scored by^ . 
teachers at thrive' of the four iristitoites and positive gains on^ SPI wepe re- 
corded for all institutes, only the mean gains at two of ^h(^ institutes were • 
significant howev.er. Success^ in increasing participants'* understanding' of 
science and scientists was indl,cated by the** findings • 

Similar findings of. significant g^iios in .pre-post-test TOUS scores by 
institute participants were reported by Dean (2^) and Southerland (115), 
Using the Wisconsin Inventory of Science Proces.^ (a modification of tHe SPI) , 
Sutherland (118) also found significant gains ' recorded by institute partici- 
pants in prGtest-posttes t measurements. ' * 

Related studies include Brekke (16), Fowler (39), George and Rose (42), 
llulleman (55), LaShier (06, 67), Mayer, Disinger and White (76), McCormick' (77), 
Merkle (80), Ost (93) , Thpmpson (122), and Villavicencio (12^, 

The studies^ited included a variety of instruments administered to 
different populations under dif;Eerent conditions, Th- overall results, how- 
ever, suggest^ th^t gains were made by most participants. To the extent that 
the various instruments measured an understanding of Science, it appears that 
the institutes were successful in promoting a better understanding of the 
nature qf the scientific enterprise. It should be noted, however, that changes 
in scores were often found not to be significantly related 'to attitudinal ^ 
changes and wetjs not necessarily indicatiye of altered,- teaching behaviprs?. 



Career Effects "^1^ * # . . . 

Because the teachei* v;as the primary focus of Lho ^n^5tJtote ProKVam, 
V. considerable attention was devoted to atLemj/ting to assess thti. impact of 
various institutes upon the teaching careers of the participants. Specific 
concerns were related to determining how many remained in teaching- following 
/institute participation, wh^t changes iu job mobility occurred, whether or 
I not participants assumed increased responsibility and lec4dership and 

whether , professional activities and membership* in professiona^drganizations 
increased . 

Brekke (16) reported a follow-up study of participants who had attended 

^^ 

institutes at the University of North Dakota over a five year petiod. He 
'found that few participants left t&^chiug to go into other professions, but 
some did leave public .school teaching to instruct at the college level. He 
also found that most of the part^icipants remained in the same schools in 
which they had taught prior Vo their institute experience, and of those who 
changed,' most remained within the same state and vent to larger systems. 
Although rftost other studies reported .|:ew participants leaving the teachjLng 
profession, most indicated greater mobility than that reported in this study. 
The principals in Brekke 's sample were positive in their ratings of partici- 
pants' gains and improved teaching and. also positive^ but somewhat lowei in 
their ratings of the extent to which participants sought to assist in dc 
vuloping new instructional and curriculum materials and to assume more rcsponsl^ 
bilitics as consultants and advisors. Brekke fpund that most participants 
were encouraged in continuing their education, most indijcated that they would 
continue even without institute support; 
.5* 
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Jenkins (59) evaluated the first five AYI's held at the University of 
Utah vf ^01^ 1957 to 1963 based upon a 90,5 percent response to questionnaires 
mailed to 243 past participants. Among other findings, it was determined 
that 71 percent were teaching iulltime.in secondary schools, 7 percent were 
teaching parLtime along with counseling or administrative duties, 6.5 percent 
weie administrators or supervisors, 11 percent were teaching in colleges, and 
4 percent had left the education profession. The large majority of par- 
ticipants believedv they had made improvements in prestige, attitudes/ leader- 
ship,^ and professional growth. 

The influences on employment status, subsequent academic preparation, 

and professional image were investigated by Wittwer (134) as one means of 

o 

evaluating a Research Participation Program at the University of Wisconsin » 
. A structured questionnaire was directed to each of the. 87 teachers who hCid 
participated in the program at some time during the 1959-1966 period, Ap^roxi 
mately 40 percent of the teachers reported changes iii their places of employ- 
ment or job responsibilities since first becoming participants^in the RPP, 
Of these teachers, about 45 percent reported these changes as a direct con- 
sequence of their RPP experience. Fifty percent of the RPP teachers returned 
to ,graduate school after participating the program and nearly 45 percent in- 
dicated that additional graduate credit was earned as a consequence of the 
RPP experience. As a consequence of -their RPP e^^periencc, more than half 
of the teachers joined ^^professional societies and more than 80 percent were 
influenced to frequently review research journals. More than Uiree-f ourths 
reported a gain in prestige and dignity among their students, colleagues, 

and administrators. Nearly all reported increased competence, effectiveness, 
it 

and self-confidence as teachers, 

I 
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Macon (72), as a part of a study of characteristics and opinions of 

participants of AYl's held at The University of North Carolina at Chapel 

Hill from 1968 through 1971, reported several post-lmjtitutu proCcsyloiiai 

characteristics. Of the 58 respondents, 9^k5 percent had earned •the M.A.T. 

degree and 5.5 percent had^applied AYI work toward other advanced degrees; 

60 p^rG^ent hard attempted additional graduate study. Changed . teaching positions 
■f 

were reported by' 63.8 percent while 29.3 percent' had changed states of em- 
ployment^. Nineteen percent were in educational positions considered higher 
than high school and 5.8 percent were no longer in education. The number 
of department heads increased from 8.6 percent before AYI experience to 15.5 
percent after. E^ucat;ional leadership roles since their AYI participation 
\were reported by 48."3''"percent. Membership in professional organizations was 
increased with membership in NSTA nearly doubled, following institute experi- 
ence* Macon concluded that the AYI experience influenced the participants 
to increase their mobility, leadership roles, professional activities, and 
professional status. 

Wldle the findings varied among the studies, there V7ere areas of agree- 
ment. Dyche (30) foun^ participants .of summer institutes at the' University 
of Montana from 1961 Lo i971 .were not influenced to seek careers in business* 
industry or school administration. Similarly, Gray (44) found, that while 
participants oi summer institutes held at the University of Mississippi f?:om 
1957 to 1969 had improved their professional status, the majority of the 
respondents vere employed in the secondary schools in 1970. Jz^ra (31), 
in evaluating aspects of summer institutes held at the University of Alabama ^ 
from 1957 to 1962, found thi^ over 90 percent of tlie participahts were still 
classroom teachers in 1963 and that only three participants held left the 
educational profession. ' 
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While a large percentage .of institute participants returned to the clas's- 
room, a -fairly high degree of mobility was reported in several studies,. 
Bradberry (14), in studying participants of AYX's held at six southeastern 
universities, found that 148 of 348 respondents were no longe^ teaching on 
the secondary level. She also found that approximately two- thirds of the 
teachers had accepted additional responsibilities, such ^s department head 
or curriculum coordinator, since attending the academic year institute, 
Roye (104) studied modifications of professional characteristics of partici- 
pants in AYI's conducted at Arizona State University during 1962 and 1963 and 
found that tie experience did not .stimulate a desire in the participants to 
leave Lhe teaching profession. He concluded that the AYI expeijience seemed 
to have cpntributed strongly to participants' dissatisfaction with their prior 
teaching position and w^s of significant value in acquiring a^ new position, 
which most participants had done by the time of the study in 1968, 
^ The relationship of career effects to institute paifticipation was also 
an aspect of the following studies*. CJibney (43), Heideman (49), llighwood and 
Mertens (52), Horner (53), Irby (56, 57), Klitnas (63), Marshall (73) 
Martinen (74) , Miiliken (81) , Redburn (100) , and Slawson -(114) . 

Based upon the evidence presented, it appears that a large majority of 
the patticipanLs remained in the educational field for at least three to five 
years following their institute experience^* Job mobility was apparently 
significantly increased following institute experience* Although a causative 
relationship cannot be definitely - established, it appears that attendance at 
one or more institutes was a factor in teachers moving from one position to 
another, from teaching to administration or supervision, or from teaching in 
an elementary or secondary school to college or university level instruction. 
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A related factor waB continued graduate study which certainly seems to have 
been increased following institute experience. Fmally, increased professional 
activity as suggested by such indicators as higher frequency of usage of 
Journal and periodical literature and increased membership in professional 
organiaations and societies, also appeals to have been related to participation 
in the Institute Program. ' * 
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0 , IMPACT ON STUDEiJTS 

As the NSF Teacher Institute Program developed, iminediate concern and 
• #' 

attention was directed toward the teachers.. The effect upon students of 

^'..-^ h ^ 

these teachers, 'although one step removed from the Institute Program in the 

operation of most of the inst^-tutes, was a secbo^ majpr focus. As the pro- 

gram was generally envisioned (65), it was intended, ultimately, that student 

achievement in science should b^improved, that attitude toward and interest 

in scieriQe be influenced in a positive direction, and that understanding of 

science as a way of investigating and learning be, increased • As ^ long 

range goal, it was desired that more students \^uld elect future science or 

science related courses of study and careers. Studies related to students 

will be summarized in the three subcategories: Cognitive Achievement, Attitudes 

and Interests, and Understanding of Science, • , ( „ 

Coghitive Achievement ♦ 

Of the studies related to student factors, a majority dealt With achiever > 

ment in science. \^iile such achievement car>^ies with it a connotation of 

incre^ased understanding of science,, the studies ciped here will be reviewed, 

primarily with respect to cognitive achievement and considerations of chapges 

in student .understanding of science in a broader sense will be treated separately, 

* ' - i * 
Bricker and LaShier (17) evaluated a CCSSP< summer program which involve^ 

47 elementary school teachers and principals in being prepared to teach the 

Science - A Process Approach (SAPA) . * Tweilty-six of Ihe participant's taught 

SAPA in grades K-3 .during the following year. Four sets of competency tasks 

were compiled -from the Competency Measures to measure gains in student achieve- 

ment over the- year. The design provided for pretesting in September 15 control 
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students and 20 experimental students randomly selected at each grade level 
from kindergarten through three. Both groups were again tested in May, The ' 
Mann-Whitney U statistic was u^ed to test f or , differences Setween the groups. 
It was found that, at all four grade levels, there were nonsignificant pretest 
differences between^^the experimental and' control groups, Posttests in all 
four grades, however, indicated that significant; achievement differences 
existed in favor^ of the eicperimental group. It was concluded that students 
involved in the SAPA program consistently achieved more of the stated objec- 
tives than did the students in the control group, 

A similar study is repotted by'lg^Shier and Kurtz (68) on the evaluation 
of another CCSSP institute conducted at Kansas State Teachers College in 
1969-70, Thirty elementary school teachers and fiye administrators* partici- 
pated in the program which was designed to prepare the participants to imple- 
,ment the SAPA program. In addition to various teacher factors considered, 
student achievement was evaluated. In the fall of 1969, 108 students were 
pretested using one of four forms of a Set of Competency Tasks , In the spring 
97 of these same students 'wpre given the posttest. The students in. this 
sample population were divided into control and ^'experimental groups based 
on whether they had received instruction in SAPA, The Mann-Whitney .U test 
was used to determine whether any significant differences existed between the 
control groups and experimental groups at the beginning of the year and after 
the .experimental group' had received instruction in the SAPA materials. The 

analysis of initial differences between the four pairs of experimental and 

* . <- 

control groups indicated that only in one of the four pairs of groups did a 

significant difference exist prior to instruction. In this 0ne case* the ex- 

periwencal group outperformed the control group. On the posttest scores, , 

1 
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the analysis indicated that the experimental groups scored significantly 

higher than the control group in 'three of the four cases. 

Selser (111) assessed the effectiveness of an inservice institute in 

increasing knowledge of content and the ability to understand' and use broad 

concepts of science dnd mathematics. As £i part of the evaluation, he compared 

scores of 745 pupils whose teachers had participated in the institute with 

* *• • , 

scores of 761 pupils whose teachers had not attiended the institute. Among 

the instruments used were the Sequential Test of Educational Prqgress (STEP), 

Science, Level 3 and the STEP, Mathematics, Level 3. Some of the findings 

include: science pupils taught by institute participants scored significantly 

higher on the STEP, Science, ^than did science pupils taught by the. control 

teachers; and, at the seventh and eighth grade levels, pupils^ taught mathe- 



ma 



tics by participating mathematics teachers scored significantly higher on 



the STEP, mathematics, than did pupils taught by the control teachers; the 
ninth grade pupils of mathematics -participants made higher mean scores than 
did pup'ils of the control teachers but the difference was not significant. 
Sc]ser also founds that when the means of the individual grade levels for 
science and mathematics scores for the STEP tests were pooled, the respective 
participating pupil groups scored significantly higher than did the control 
groups. 

An inservice program for earth scpLence teachers was evaluated by Mayer, 
Disingcr and White (76) in a study which included an assessment of cognitive 
growth of students in the claisses of participants. To determine this, the 
Test of Science Knowledge (TOSK) was administered in all classes early in 
Octobery 1969 and again in la»te May, 1970. They found, using t~tests for 
matched pairs, that TOSK, Part I (Factual Information) means increased 
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significantly. The difference in TOSK, Part II (Principles), means was \ 

positive but not statistically significant. It was indicated that th^e CCJJS 

Program was successful in helping participants be^effective in, among other 

things, improving student understandings of science concepts and processes, 

Behringer (8) examined the modification af biology curricula developed 

as part pf a CCSSP program for use by 35 teachers and 4,264 students. The 
-I • * . 

biology students were grouped into ability levels with the average group 

using the unmodified BSbs Yellow ^ersion and the slow learner groups and the ^ 
accelerated "group usipg modified cuxricula. For experimental design purposes, 
some classes in each of the low and high ability groups were taught With the 
unmodified pi^gram. Th6 data indicated that gains in learning were signifi- 
cant for all groups; ,that the differences in achievement between groups using 
modifie'd and unmodified materials were tiot significant; and that gains in 
learning for groups using, unmo^lified materials were significantly greater for 
the average students than for either tTie slow" learner ^^accelerated groups, 
indicating that modifications were, desirable for slow learners and accelerated 
students. , , , . . 

^ . A ^ 

Brekke (16), in evaluating the effectiveness of institute programs held 
it 

over a five-year span, examined various indicators oJi> student achievement. 



He founci th^t University of North Dakota admis,sion records based on standard-' 
ized tests showed a gain of more than ten points in achieyement in t'.e science 

area for students taught by institute part4.cipaT\ts before and after i he teachers 

(' ' * 

institute experience. He also found that institute-trained teachers had several 

•ft 

students admitted to prestige schools noted for rigorous programs in science 
and mathematics. Non^nstitute teachers, on the other' hand, had none of 
their students admitted to the same institutions. 
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Student achievement was also included as a factor in studies by Ahlgren (2 
Bingham (11), Bridges, Bingliam and Green (18), Howe (54)^ LaShier (66, 67), 
Thele'n and Litsky (121), Tweeten (123), Uffelman, Magooti, Idstein and Yolles 
(124) , and Villavicencio (125) . 

Student gains in achievement were reported in nearly all the documents 
reviewed • The r.elationship oT these gains to teacher^ attending one or more 
institutds was not always clear,,. In at lea6t one study (12^), students taught 
by nort^patticipants scored significantly higher on both pretest and posttest 
administrations of th^ American Chemical .Society (ACS) test than did students 
taught by par ticipants • On the whole, however, the evidence suggests "a 
positive relationship between teacher participation in an institute and achieve 
meat gains by that teacher's students. BCf should be noted that other factors 
such as test bias or knowledge of participation in an experimental program, 
may influence results, hence a causative relationship is not clearly defined. 

". : ^ ^' ' ■ . ■ 

Attitudes and Interests 

Attempts to assess attitudes and interests have consistently been plagued 
by the elusive nature oT these factors. The studies summarized here reflect 
this difficulty and present several instances of findings and results at 
variance with one another. - . 

Bridges, Bingham and Green (18), in evaluating a CCSS Program designed 
to prepare teacjiers to teach the DISCUS program, examined the effects on 
underachieving junior high youths with respect to theif knowledge of science, 
and their attitudes toward themselves, their teachers, and their school. The 
basic approach underlying the program was that the underachievers were sepa- 
rated fr6m their more successful peers, placed in a success-oriented >environ-^ 
ment, provided vfith a series of small group activities, used a directed 
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discovery approach while carrying on the activities, and used data from their 
activities in arriving at meaningful concepts via discussion techniques. It 

as found that the treated groups achieved a better understanding of science^ 
and displayed better attitudes toward themselves, their teachers, and their 
school than did non-treated groups. Also, the groups taught .by teachers 
trained in the tCSS Program were found to have achiev(|d a l?etter understanding 
of science, and displayed better attitudes than those taught by non-trained 
teachers . ' * ' 

A pretest-posttest , nonequivalent control, design was employed by 
Lauridesen (69) to Compai^e the ef f ectivensss of ISCS Level One with non-ISCS 
seventh grade science classes in 1) fostering positive growth in the scientific 
attitudes associated with the nature of scientific laws, the limitations of 
science, and the desirability of science as ^ vocation; 2) enhancing the self- 
reliance level of seventh grade students; and, 3) in elevating the ranking the 
students gove to science when ranking five classroom subjects in order of pre- 
ference. Data were collected from more than 650 students in 'clashes of 15 

^ ISCS Level One teachers who had participated in a CCSS Summer Institute at 
The University of Kansas. More than 200 non-ISCS respondents were in classes 
of eight non-I§CS teachers each of whom taug^ht in a school district represented 
by the 15 ISCS teachers. Discriminant analyses were performed on the pi Lest 
and posttest data collected with instruments designee? to iileasu re sclent ic * 
attitudes, sel£-reliance, and classroom subject preference. It Vas foui.J ^ ^. 
that the ISCS group experienced a significant positive increase in the attitude 
associated with the nature of scientific laws, while the non-ISCS group did 

' not undergo as larg6 a positive change in this attitude. The non-TSCS group 
.experienced a significant negative change in the attitude associated with the 
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desirability of science as a vocation; the ISCS group also experienced a 
negative change which was nearly as great, Botti groups e^cperienced a non- 
significant increc?se in the attitude associated with tlie limitations of sci- 
ence. Botji groups also ranked science ],ower, but^not significantly so, on 
t\\e preferential ranking of classroom subjects on the posttest than on the 
pretest. Finally, both groups experienced nonsignificant increases in self— 
reliance. The findings led to the conclusion that the Level One program has 
not complete]y met its objectives.^ 

. ^ Spradlin (li^) t in an investigation of the behavior change of 50 scicnc 
teachers who had participated in a summer institute, studied attitude changes 
of the teachers' 12A0 secondary school students. A Student Semantic Dif- 
ferential was administered at' the close of the school year prececding the 
summer institute and again following the next teaching year. She found no 
statistically significant differetice in the ^ittitudc.s of the students towar^ 
the world of science, science class, science teacher, science laboratory, or 
school before and after the teachers' institution participation. There was, 
however, a positive trend which, it was suggested , could become more positive 
as the teachers grew more secure in thp use'of new activities*^ 

Ost (93), as part of the evaluation of an institute for biology teachers 
investigated the difference in the preference of the students of the in- 
stitute participants for biology, before and after attending the institute. 
The Subject Preference Syrvey was administered to the participant's first 
biology class of the day during April preceeding the participant '4 attendance 
at tW in^citute and again six months after the institute. No significant 
difference between pretest and posttest scoi(es was found, suggesting th^t 
students in science classe^: of institute participants neither increased nor 

5 

K - 

\ 

35 



decreased the±i: preference for Lho science tourwr. It w«i« iioLod Ui.il nlLluui^»,li 
an immediate change in stuffenl preferc-ncu was nut diitecled, the n^sults dJd 
not preclude the possibility of a long-term effect. 

Thompson, Irwin, Baiiman and Sanders^ (122) analyzed data from question- 
naires adn^inistered to thtee randomly selected studenL?5 in each class of a 
randomly ^s^elected sample Qf one-third of the participants from each of 26 
ESCP institutes.^ Among the results reported, the majority of the students 
felt the'ii: earth science course was worthwhile and 64 percent were more in- 

teres ted in earth science at the end of the year than at the beginning. 

• # 

Studies dealiiig with student^' interest in future career choices yielded 
contradicatory .results . ^rekke (16), in a followup study of participants 

" I ■ ^ 

who attended NSF in?titutes at the University of North 'Dakota, reported some 
comparisons between students of institute and non-institute trained teachers. 
He found that in-titute participants reported a proportionate gain of eight' 
p<^rcent in the number of students going on to college from one year to the 
next (compariixg graduates before and after teacher's institute attendance) 
who enrolled in coursesr^in science and mathematics fields. Non-institute 
trained teachers repor4:ed a gain of ^ix percent from one year t6 the next of 
students enrolling in college for science and mathematic/ careers. Positive ' 
results were also, indicated by Slawson (114), who attempted to determini id 
analyze the impact and influence that participation in AYl's at the Uni^ >ity 
of Virginia had on former science participants. One of his conclusions ^ > 
that the AYl Program hitid^^d a positive effect on the former science partici- 
pants in terms of ability to motivate students toward .careers in science. 
Jenkins (59), however, in evaluating the.AYl Program at the University of 
Utah, concluded that the overall effects 'of tlie program towarda the goal of 
Influencing more students to choose scientific or mathematics careers were 
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Additional studies which considered attitudes and interests include 
those reported by AhJgren (2), Bartlett and Edgerton (6), Bogen (13), Bruce 
ana Paralch (2^); Dean (28)? Kliinas (63), LaShier (67), nnd Royo (10/0- . 

.--rtn5r-.positive relationships bc^twccn the teacher inlitute program cnul h\' 
creased interest rin, or improved attitudes toward, science on the. part of 
students of participants cannot be supportLd on the basis of the studies re- ' 
viewed. On the other hand, neither can negative changes, in student attitudesr^ 
or interests clearly be attributed to teacher parti,cip?ltion in the institutes. 

! 

Understanding of Science 

A number of studies examined *:he science achievement of students from 
which some inferences about' the students' understanding of^ science might be 
drawn with ifespect to a specific area. Very few studies dealt wit]x*the under- 
standing of science in the broader s.ense of considering the nature of the 
scientific enterprise.. . • , * • 

* 

Bruce and Parakh (22) reported on the evaluation of a Research Partici- 
pation Program conducted at Cornell University during 1963-1964.^ As a part 
of this study, they . evaluated the Effects attributed to the progtam on 51 
student 'assistants. One form of evaluation, involved the use of ra:ting "forms 
completed by participating scientists, teachers and student assistants. All 
three groups rated the Students hig!;i on general interest. Studeht contributions 
to problem solving and value of suggestions were both tated fair to good by 
all three groups. A high rating was given by all three groups to itfcms con- 
cerning noticeable increases in scientific attitudes and critical thinking 
on the part of the students. A second form of evaluation was the ^dministra- 
tion of the TOUS instrument to 46 matched pairs af student assistants and 
non-participating students. The test was given twice, first early in the 
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program and again near the end of the program. A. test for homogeneity of 
variance on pretest scores revoaJcd no significant difference ^''twurn the j'.roup.s 
suggesting that the students were wcil matcl^cd on their oripLnal understand Inj; 
o( science* The mean gains in score, for total as well as subscales, by the 
student assistants were not significantly different from the mean gains in 
score by the matched non-participating students. It was noted, however, that 
total scores on the first test wjere high j about half the students scored 
or above the 90th percentile, suggesting that a ceiling^ef f ect was in operation. 

LaShier (67), in evaluating ACCSS Project for ISCS teacl>d*ts, s.tiudied a 
Series of factors related to student, achievement , attitudes and understanding. 
Based upon th^lr progress an3 scores on achievement tests, the ISCS students 
were separated into high achievers and low achieving by selecting the top third 
and 'bottom third, respectively, of the group. The instrument used included 
measurement .of student attitudes toward science as an approximation to truth, 
and scicnqe as 'an empirical discipline. Significant differences were found In 
scores achieved by the two groups on both measures. It v;as concluded that 
high achieving ISCS students had a significantly better" conception of science 
as approximate and changeable th^n did low ISCS achievers* Similarly, the 
high achieving ISCS students had a significantly better grasp of science as 
empirical, or based on natural phenomena, than did low achievers. 

Ahlgren (2), in an interim report, summarized various aspects of the 
evaluatipn of Project Physics including student gains on TOUS^ and SPI. iL 
random sample of 100 teachers were selected from a list of 16,911 h^^h school 
physics teachers. Of the 70 who agreed to participate, 40 teachers were ? 



randomly selected to teach Project Physips and 30 to teach as they would have 
ordinarily taught. Among other instruments, TOIIS an^ SPI were administered 
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to fche students on a pretest-posttest basis. It was concluded that the Project 
Physics scored higher on both TOUS and SPI than they would have if they had 
been In the control group, classes. 

'Other studies dealing with students' understanding of science include 
Bingham (11), Bridges, Bingham and Green (18), Dean (28), Mayer, Disinger 
and White (76), Selser (111), and Villavicencio (125). 

As is apparent frOm the studies described, the findings related to 
students' understanding of the nature of science were not consistent.' More- 
over, because most of the studies dealt with this concern in a descriptive 
manner, clearly defined relationships are few. In general, it appears that 
students whose teachers had had institute expeflrience were likely to have a 
somewhat better understanding of science than were students of non-participants. 
However,, , it is by no means certain that such a difference was significant. 
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"SUMMARY ' 

In summafi/.lng the re^iull« prosenLcJ Jii the JiLudJts reviewed, the fainuiKirlcs 
of findings with respect to teachers and to their students will be examined in 
an attempt to determine the probable impact of the NSF Teacher Institute Pi:ogfam* 

The studies which examined ''the characteristics of participants, rejectees, 
and ^n-applicants suggest that, in general, the institute participants were 
those who most likely were the better qualified te^achers while the non- 
applicants were more likely to be the least qualified. On the surface it appears 
to be a case of the rich,, educationally, getting richer. But the participants 

were als^j^.. those teachers who tended to teach mgre science courses, have con- 

< 

tact with inore students, be more active in professional and leadership roles, 
and who were most likely to remain in teaching* On the basis of the jcharac- 
teristics and selection of participants, then, it must be concluded that the 
effect of the Institute Program was positive. 

Several studies noted that participation ia teacher institutes was the 
most important factor in increasing the content background of teachqrs. In 
this respect there was agreement by teacher-participants, administrators and 
supervisors, and college and university personnel. Based upon the evidence 
presented, there was, virtually unanimous agreement that the participating ^ 
teachers' subject matter competence had been significantly improved und that 
the Institute Program had clearly beren successful in this regard. 

Changes in teacher attitudes were investigated in several studies with 
highly mixed results. Positive changes were found in several instances, and 
in some cases these appeared related td some aspect of the institutes. How- 
ever, enough findings of no-significant-difference or of negative changes, 
togdther with findings of uncertain relationships between attitudes and 
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institute experience suggest tliat ^ny conclusions drawn would be so tenuous 
as to be of. little value. It is nonetheless clear that the majority of the 
participants had positive attitudes toward their institute experience and 
viewed the results as beneficial. 

A large ni^iber of studies investigated changes in teacher bcliavior follow- 
ing institute participation. Based upon the f^^H^Iirgs reported, it appears 
that there were changes and these changes tended to be in the direction desired 
by the institutes. Ifliile the fact that the better prepared, and thus prqbably 
the more capable, teachers were most likely to be selected as participants 
cannot be discounted, it appears that the Institute Program was probably ^ 
causative agent in bringing about improved teaching behavior. The permanence 
of such improvepient is not, however, established. 

In the area of teachers' understandings of' the nature of science con- 
siderable variation was found in instruments used, populations assessed, and 
reported tcsults. Based upon the assumption that the instruments administered 
did measure, to some extent, an understanding of the aims, methods, and 

processes of science, it appears that significant ^Improvement, did occur on 

* ' t- 

the whole. The relationship of this change to the institute experience of 

the teachers is not clear. Because institute participation was one of the. 

few factors common to all the studies, it seems reasonable to conclude that 

the' Institute Program was a positive factor in this effect. 

With respect to the effects on the careers of teachers, it appears that 

several changes occurred following participation in the Institute Program. 

Although relatively few left the education field, the teachers did become 

mor6 mobile, moving from one position to another, from elementary or secondary 

to college levels, from teaching into administration or supervision. As a- 
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group they also exhibited an increase in continued graduate study, in pro- 
fessional activities, and in educational leadership ro.lcs after atttMulinj* 
institutesNi|lflxilc again a causative relationship cannot* be definitely ctrn- 
cluded, it appears that the Instituted Program bad a positive effect on the 
careers of participants. " 

Studies of student achievement reported gains in most instances. Whether 
or not these gains can'^be a&cribed to attendance in an institute by the 
teachers, however, is not at all certain. Although in most cases g^ins were ^ 
noted for students of participants., the gains were not always significantly 
* different from gains scored by students of non-participants. In at least 
^ one case the non-participants' students outsaored the participants' students. 
" A critical factor in studies of the kind reported her6 is the appropriateness 
of the instruipents used. A, conventional or traditional,, instrument applied 
to students who have paen taught in a manner intended to be different from 
the conventional ot txadltional manner xday well score lower than a control 
group. ' Obviously, |:he con\jerse would be equally true. Evejci the knowledge 
that they wre participating in an experimental program could influence 
J students in such a way as to alter achievement test scores. Because factors 
such as those cited appear to bei potentially significant, any relationships 
between the Ihstitute Program anq student achievement in science remain unclear. 

Student attitudes toward, and interest in, science were the basis for 
several studi<.^s. The findings, however, were at variance with one another. 
All three conditions, positive changes, negative changes, and no changes, 
were reported.. No general relationship between changes, or lack of changes, 
in student attitudes or interests and teacher participation in an institute 
can be determined. 
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Studies related to Student understanding of the nature of science were 
very few in number and generally descriptive in nature. The findings reported 
were not consistent and do not support any well defined relationship between"* 
teacher institute experience and student understanding of science, T'Jhile 
the studies suggest that students of participants were likely to have a some- 
yhat better understanding of science than were students of non~participants , 
the difference cannot be considered significant nor necessarily attributable 
to the Teacher Institute Program, 

In reviewing the overall impact of the Teacher Institute Program, it 
should be noted that the studies reported ane repre3entative of the studies 
done rather than an exhaustive compilation. Because it is a fairly extensive 
sample, U^e results reported can be expected to present a reasonably acQurate 
view. In conclusion, while there are areas where data were' scant and where 
results were not definitive, the National Science Foundation Teacher Institute 

V 1 

Program appears in general to have been successful in making a significant, 
positive impact on science , education. 
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